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Abstract. We address the minimization of the sum of a proper, convex and lower semicon- 
tinuous with a (possibly nonconvex) smooth function from the perspective of an implicit 
dynamical system of forward-backward type. The latter is formulated by means of the 
gradient of the smooth function and of the proximal point operator of the nonsmooth 
one. The trajectory generated by the dynamical system is proved to asymptotically con¬ 
verge to a critical point of the objective, provided a regularization of the latter satisfies 
the Kurdyka-Lojasiewicz property. Convergence rates for the trajectory in terms of the 
Lojasiewicz exponent of the regularized objective function are also provided. 

Key Words, dynamical systems, continuous forward-backward method, nonsmooth op¬ 
timization, limiting subdifferential, Kurdyka-Lojasiewicz property 

AMS subject classification. 34G25, 47J25, 47H05, 90C26, 90C30, 65K10 

1 Introduction 

In this paper we approach the solving of the optimization problem 

inf [/(a^)+5(a^)], (1) 

where / ; M"" —>■ M U {-|-oo} is a proper, convex, lower semicontinuous function and g : 
M” ^ M a (possibly nonconvex) Frechet differentiable function with /3-Lipschitz continuous 
gradient for /? > 0, i.e., ||V 5 (x) — V 5 (?/)|| < \\x — y\\ Vx, y € M”, by associating to it the 
implicit dynamical system 



where ry > 0, xq G is chosen arbitrary and prox^^j ; M"" —>■ M"', defined by 

prox,^/(y) = argmin I f{u) + - y\\^ \ 

usK" I j 
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is the proximal point operator of rjf. 

Due to the Lipschitz property of the proximal point operator, the existence and unique¬ 
ness of strong global solutions of the dynamical system ([2]) is ensured in the framework of 
the Cauchy-Lipschitz Theorem. 

The asymptotic analysis of the trajectories is carried out in the setting of functions 
satisfying the Kurdyka-Lojasiewicz property (so-called KL functions). To this large class 
belong functions with different analytic features. The techniques for proving the asymp¬ 
totic convergence of the trajectories generated by (l2|) towards a critical point of the ob¬ 
jective function of ([T]), expressed as a zero of the limiting (Mordukhovich) subdifferential, 
use three main ingredients (see [6l|T3l|23] for a similar approach in the discrete setting). 
Namely, we show a sufficient decrease property along the trajectories of a regularization 
of the objective function, the existence of a subgradient lower bound for the trajectories 
and, finally, we obtain convergence by making use of the Kurdyka-Lojasiewicz property 
of the objective function. The case when the objective function is semi-algebraic follows 
as particular case of our analysis. We close our investigations by establishing convergence 
rates for the trajectories expressed in terms of the Lojasiewicz exponent of the regularized 
objective function. 

Let us mention that in the context of minimizing a (nonconvex) smooth function (wich 
corresponds to the case when in ([1]) /(x) = 0 for all x G M") several first- and second-order 
gradient type dynamical systems have been investigated by Lojasiewicz [37], Simon m, 
Haraux and Jendoubi |3l], Alvarez, Attouch, Bolte and Redont (6] Section 4], Bolte, 
Daniilidis and Lewis m Section 4], etc. In the aforementioned papers, the convergence 
of the trajectories is obtained in the framework of KL functions. 

In what concerns implicit dynamical systems of the same type like m, let us first 
mention that Bolte has studied in m the asymptotic convergence of the trajectories of 

J x{t) + x{t) = projc- {x{t) - r]Vg{x{t))) , . 

I x(0) = xo. 

where g : M" ^ M" is convex and differentiable with Lipschitz continuous gradient and 
proj(^ denotes the projection operator on the nonempty, closed and convex set C C M"-, 
towards a minimizer of g over C. This corresponds to the case when in ([T|) / is the indicator 
function of C, namely, /(x) = 0 for x G C and -|-oo otherwise. We refer also to the work 
of Antipin [7j for more statements and results concerning the dynamical system ([3|). The 
approach of m by means of stated as a generalization of dSj), has been recently 
considered by Abbas and Attouch in [H Section 5.2] in the full convex setting. Implicit 
dynamical systems related to both optimization problems and monotone inclusions have 
been considered in the literature also by Attouch and Svaiter in m, Attouch, Abbas and 
Svaiter in |2| and Attouch, Alvarez and Svaiter in m- These investigations have been 
continued and extended in [T71I25II28] . 

Finally, we would like to emphasize that the time discretization of dJj) leads to forward- 
backward iterative algorithm 

Xfc+i = prox^j(xfc - r]Vg{xk)) Vfc > 0, (4) 

where the starting point xq G M" is arbitrarily chosen. This splitting method, which 
is in the convex setting well-understood (see for example m). has been investigated 
in several papers in the nonconvex setting for KL functions, too. We refer the reader 
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to [TTHT3l[23l[Ml[2^l3Tl[32l[35ll39] for different techniques and ideas used for carrying out 
the convergence analysis of iterative schemes of same type like ([H) in the nonconvex setting. 

2 Preliminaries 

In this section we recall some notions and results which are needed throughout the paper. 
Let N = {0,1,2,...} be the set of nonnegative integers. For n > 1, the Euclidean scalar 
product and the induced norm on M” are denoted by (•, •) and || ■ ||, respectively. Notice 
that all the finite-dimensional spaces considered in the manuscript are endowed with the 
topology induced by the Euclidean norm. 

The domain of the function / : R” —>■ RU{-|-oo} is defined by dom / = (x G R"" : f{x) < 
-|-oo}. We say that / is proper if dom / ^ 0. For the following generalized subdifferential 
notions and their basic properties we refer to [381140] . Let / : R” —RU {-|-oo} be a proper 
and lower semicontinuous function. If x G dom/, we consider the Frechet (viscosity) 
subdifferential of / at x as the set 

dm = {„£«": ii,,i„f /M-//)-/i'-^> > ol, 

For X dom / we set df{x) := 0. The limiting (Mordukhovich) subdifferential is defined 
at X G dom / by 

df{x) = {u G R"" : dxfc — )• X, /(xfc) — >■ /(x) and dufc G df{xk),Vk v as k ^ +oo}) 

while for x ^ dom/, one takes df{x) := 0. Therefore df{x) C df{x) for each x G R”. 

Notice that in case / is convex, these subdifferential notions coincide with the convex 
subdifferential, thus df{x) = df{x) = (u G R"’ : f{y) > /(x) + {v,y — x) \/y G R”} for all 
X G R”. 

Th graph of the limiting subdifferential fulfills the following closedness criterion: if 
ixk)ken and {vk)k&N sequences in R"’ such that Vk G df{xf) for all A: G N, {xk,Vk) 
{x,v) and f{xk) —)• /(x) as A: —>■ -|-oo, then v G df{x). 

The Fermat rule reads in this nonsmooth setting as follows: if x G R” is a local 
minimizer of /, then 0 G df{x). We denote by 

crit(/) = {x G R" : 0 G df{x)} 
the set of (limiting)-critical points of /. 

When / is continuously differentiable around x G R” we have df{x) = {V/(x)}. We 
will make use of the following sub differential sum rule: if / : R'^ —>■ RU {-|-oo} is proper 
and lower semicontinuous and h : R” —>■ R is a continuously differentiable function, then 
d{f + h){x) = df{x) + Vh{x) for all x G R™'. 

We turn now our attention to functions satisfying the Kurdyka-Lojasiewicz property. 
This class of functions will play a crucial role in the asymptotic analysis of the dynamical 
system ([2]). For r/ G (0,-|-oo], we denote by 0^ the class of concave and continuous 
functions ip : [0, g) —>■ [0, -|-cx)) such that (/9(0) = 0, is continuously differentiable on (0, g), 
continuous at 0 and (p'{s) > 0 for all s G {0,g). In the following definition (see |12ll23j l we 
use also the distance function to a set, defined for A C R'^ as dist(x, ^4) = infj^g^i ||x — y|| 
for all X G R*^. 
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Definition 1 (Kurdyka-Lojasiewicz property) Let / : —>■ M U {+ 00 } be a proper and 

lower semicontinuous function. We say that / satisfies the Kurdyka-Lojasiewicz (KL) 
property at x € domdf = {x G M" : df{x) 7 ^ 0 }, if there exist rj G ( 0 , + 00 ], a neighborhood 
[/ of X and a function ip G such that for all x in the intersection 

[/ n {x G M” : /(x) < /(x) < /(x) + r]} 

the following inequality holds 

^'{f{x) - fix)) dist( 0 , df{x)) > 1 . 

If / satisfies the KL property at each point in domdf, then / is called KL function. 

The origins of this notion go back to the pioneering work of Lojasiewicz [37], where 
it is proved that for a real-analytic function / : M"' —)• M and a critical point x G M” 
(that is V/(x) = 0), there exists 9 G [1/2,1) such that the function \f — /(x)|®||V/||“^ 
is bounded around x. This corresponds to the situation when ip{s) = Cs^~^, where 
C > 0. The result of Lojasiewicz allows the interpretation of the KL property as a re- 
parametrization of the function values in order to avoid flatness around the critical points. 
Kurdyka |36j extended this property to differentiable functions definable in o-minimal 
structures. Further extensions to the nonsmooth setting can be found in |121l2ni[22] . 

One of the remarkable properties of the KL functions is their ubiquity in applica¬ 
tions (see [23|). To the class of KL functions belong semi-algebraic, real sub-analytic, 
semiconvex, uniformly convex and convex functions satisfying a growth condition. We 
refer the reader to |lllll3[[2nil23j and the references therein for more on KL functions and 
illustrating examples. 

An important role in our convergence analysis will be played by the following uni- 
formized KL property given in [23( Lemma 6 ]. 

Lemma 1 Let LI C ML be a compact set and let f : M"' —>■ M U {-|-oo} be a proper and 
lower semicontinuous function. Assume that f is constant on LI and that it satisfies the 
KL property at each point of LI. Then there exist e,r] > 0 and ip & Qrj such that for all 
X G n and all x in the intersection 

{x G M” : dist(x, H) < e} fl {x G M"" : /(x) < /(x) < /(x) -|- rj} (5) 

the inequality 

T'ifix) - fix)) dist( 0 , dfix)) > 1 . ( 6 ) 

holds. 

In the following we recall the notion of locally absolutely continuous function and state 
two of its basic properties. 

Definition 2 (see, for instance, mm) A function x : [ 0 , -|-oo) —>■ is said to be locally 
absolutely continuous, if it absolutely continues on every interval [0,T], where T > 0, 
which means that one of the following equivalent properties holds: 

(i) there exists an integrable function y : [ 0 ,r] ^ M" such that 

x(t) = x(0)-|- f yis)ds VtG[0,T]; 

Jo 
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(ii) X is continuous and its distributional derivative is Lebesgue integrable on [0,T]; 

(iii) for every e > 0, there exists rj > 0 such that for any finite family of intervals 
Ik = {O'kjbk) C [0,T] we have the implication 

4 n = 0 and ^ \bk -ak\ <r]\ ^ \\x{bk) - x{ak)\\ < e. 

V k / k 

Remark 2 (a) It follows from the definition that an absolutely continuous function 

is differentiable almost everywhere, its derivative coincides with its distributional 
derivative almost everywhere and one can recover the function from its derivative 
X = y hy the integration formula (i). 

(b) If X : [0, T] —>■ 4 is absolutely continuous for T > 0 and B : M” —>■ is L-Lipschitz 

continuous for L >0, then the function z = Box is absolutely continuous, too. This 
can be easily seen by using the characterization of absolute continuity in Definition 
[2{iii). Moreover, ^ is differentiable almost everywhere on [0,T] and the inequality 
||-2(i)|| < holds for almost every t € [0,T]. 

The following two results, which can be interpreted as continuous versions of the quasi- 
Fejer monotonicity for sequences, will play an important role in the asymptotic analysis 
of the trajectories of the dynamical system investigated in this paper. For their proofs we 
refer the reader to [21 Lemma 5.1] and [21 Lemma 5.2], respectively. 

Lemma 3 Suppose that F : [0, +oo) —)■ M is locally absolutely continuous and bounded 
from below and that there exists G G L^([0,+oo)) such that for almost every t € [0,+oo) 

j^F{t) < G{t). 

Then there exists lim^^oo F'it) £ 

Lemma 4 If 1 < p < oo, 1 < r < oo, F : [0, +oo) —[0, Too) is locally absolutely 
continuous, F G LP([0,+oo)), G : [0, +oo) ^ M, G G L^([0, +oo)) and for almost every 
t G [0, Too) 

Ifit) < G(t). 

then limi_j._|_oo F{t) = 0. 

Further we recall a differentiability result involving the composition of convex functions 
with absolutely continuous trajectories which is due to Brezis ( m Lemme 4, p. 73]; see 
also m Lemma 3.2]). 

Lemma 5 Let f : EF —>■ MU{+oo} be a proper, convex and lower semicontinuous function. 
Let X G L^([0,T], M"') be absolutely continuous such that x G L^([0,T], and x{t) G 
dom/ for almost every t G [0,T]. Assume that there exists G L^([0,T],M”) such that 
f,{t) G df{x{t)) for almost every t G [0,T]. Then the function t f{x{t)) is absolutely 
continuous and for every t such that x{t) G dom 5/ we have 

^/(x(t)) = {x{t),h) Vh G df{x{t)). 
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We close this section by recalling the following characterization of the proximal point 
operator of a proper, convex and lower semincontinuous function / : M" —>■ M U {+oo}. 
For every r/ > 0 it holds (see for example [18] 1 

p = prox^j(x) if and only if x € p + r]df{p), (7) 

where df denotes the convex subdifferential of /. 

3 Asymptotic analysis 

Before starting with the convergence analysis for the dynamical system ([2]), we would like 
to point out that this can be written as 

J x{t) = (prox o(Id -r/Vfi() - Id) (x(t)), , . 

1 x(0) = xo, 

where prox o(Id —pV g) — Id is a (2 + p/3)-Lipschitz continuous operator. This follows from 
the fact that the proximal point operator of a proper, convex and lower semicontinuous 
function is nonexpansive, i.e., 1-Lipschitz continuous (see for example my According 
to the global version of the Cauchy-Lipschitz Theorem (see for instance [9l Theorem 
17.1.2(b)]), there exists a unique global solution x € C'^([0,+oo),M”) of the above dy¬ 
namical system. 

3.1 Convergence of the trajectories 

Lemma 6 Suppose that f + g is bounded from below and g > 0 fulfills the inequality 

t 7/3(3 + p/3) < 1. (9) 

For Xo G M"", let x G (//^([O,+oo),M"") be the unique global solution of ([2]). Then the 
following statements hold: 

(a) X € L^([0,+oo); M"") and limt_).+(X) x(t) = 0; 

(b) 3limt^+oo{f + g){x{t) + x{t)) G M. 

Proof. Let us start by noticing that in the light of the the reformulation in ([8]) and 
of Remark [2lb), x is locally absolutely continuous, hence x exists and for almost every 
t G [0, +oo) one has 

||ai(t)|| < (2 + p/3)||x(t)||. (10) 

We fix an arbitrary T > 0. Due to the continuity properties of the trajectory on [0, T], 
()inh and the Lipschitz continuity of Vp, one has 

x,x,x, Vp(x) G L^([0, Tj; M""). 

Further, from the characterization ([7]) of the proximal point operator we have 

- -x{t) — Vg{x{t)) G df{x{t) -I- x{t)) \/t G [0, -|-oo). (11) 

V 
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Applying Lemma [5] we obtain that the function t !->■ f [x{t) + x{t)) is absolutely continuous 
and 

+ x{t)) = - Wg{x{t)),x{t) + 

for almost every t € [0, T]. Moreover, it holds 

^9{x{t) + x{t)) = {Vg{x{t) + x{t )), x{t) + x{t)) 
for almost every t € [0, T], Summing up the last two equalities, we obtain 


+ 9 ){xit) + x{t)) = - V5f(x(t)) + Vg{x{t) + x{t)),x{t) + x{t) 


1 d 


1 


+ {'^9{x{t) + x{t)) - Vg{x{t)),x{t) + x(t)) 

- ~ ~ + /^II^WII ■ WHt) + X 

< - ^l(ii^wii') - +/5(3+ vmmf 


2g dt 




- /3{3 + gf3) 


X 


( 12 ) 

(13) 


for almost every t G [0, T], where in (1121) we used the Lipschitz continuity of V(7 and in 
(fT3|) the inequality ([TO]) . Altogether, we conclude that for almost every t £ [0, T] we have 


A 

dt 


if + 9){Ht) + xit)) + 


1 

2g 



/?(3 + r//3) 


x(t)f <0 


(14) 


and by integration we get 


{f + g){x{T) + xiT))+^\\xiT)f + 
if + g){x{0) + x{0)) + ;^l|i(0)f. 


13(3+ V/3) 


f 


\x 


'dt < 


(15) 


By using ([9]) and the fact that f + g \s bounded from below and by taking into account 
that T > 0 has been arbitrarily chosen, we obtain 


X € l2([0,+oo);M'^). 


(16) 


Due to m, this further implies 


X £ L^{[0,+oo)-,'R^). 

Furthermore, for almost every t £ [0, +oo) we have 

^(II^WlP) = ^x{t),x{t)) < ||x(t)f + ||x(t)f. 


(17) 
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By applying Lemma 01 it follows that limt^+oo x{t) = 0 and the proof of (a) is complete. 
From Cl, (© and by using that T > 0 has been arbitrarily chosen, we get 


A 

dt 


if + g){x{t) + x{t)) + 


< 0 


for almost every t € [0,+oo). From Lemma [3] it follows that 


lim 
t —^“|~00 


1 


{f + g){x{t) + x{t)) + -^\\x{t)f 


exists and it is a real number, hence from limt^+oo x{t) = 0 the conclusion follows. ■ 
We defined the limit set of x as 

uj{x) = {x € M" : —>■ +oo such that x{tk) —)■ x as A: —>■ +oo}. 

Lemma 7 Suppose that f + g is bounded from below and rj > 0 fulfills the inequality ©. 
For xq G let x G C^([0, +oo),]R'^) he the unique global solution of jS]). Then 

oj(x) C crit(/ + 5 ). 

Proof. Let x G lu(x) and t^ +00 be such that x(tfc) x as k ^ + 00 . From (fTTTl we 
have 

1 


--x{tk) - Vg{x{tk)) + Vg{x{tk) + x{tk)) G df[x{tk) + x{tk)) + Vg[x{tk) + x(4)) 


= d{f + g) {x{tk) + x(4)) \fk G N. 
Lemmata) and the Lipschitz continuity of V^f ensure that 

- ^x{tk) - Vg{x{tk)) + Vg{x{tk) + x{tk)) 0 as A: —+00 


and 


We claim that 


x{tk) + x{tk) ^ X as A: —>■ + 00 . 


lim {f + g){x{tk) + x{tk)) = {f + g){x). 

K —^“tOO 


Due to the lower semicontinuity of / it holds 


liminf f{x{tk) + x( 4 )) > /(x). 

fc—>-+oo 


(18) 

(19) 

( 20 ) 
( 21 ) 

(22) 


Further, since 


x{tk) +x{tk) =argmin 
ueK" 


= argmm 
ueR" 


/(«) + ^ Ih “ “ V'^9{x{tk))) II 

/N + 7^11^ “ 3 ;( 4 )|p + {u- x{tk), Vg{x{tk))) 
2r] 










we have the inequality 

f{x{tk) + x(4)) + ^\\x{tk)f + {x{tk), V5f(x(4))) 

< fix) + 7 ^ 11 ® - x{tk)f + {x- x{tk), Vg{x{tk))) yk € N. 

Irj 

Taking the limit as A: —)■ +oo we derive by using again Lemma [6l[a) that 

limsup/(x( 4 ) +x( 4 )) < /(x), 

k^+oo 

which combined with (j22l) implies 

lim f{x{tk) + x(4)) = fix). 

k^+oo 

By using (j2nh and the continuity of g we conclude that (I21h is true. 

Altogether, from (fTSj) . (fTOl) . (l20l) . (|2T]) and the closedness criteria of the limiting sub¬ 
differential we obtain 0 G d{f -I- g)ix) and the proof is complete. ■ 

Lemma 8 Suppose that f + g is bounded from below and g > fulfills the inequality @ . 
For xo € M"", let x G <^^([0, -|-oo),]R"^) be the unique global solution of ([2|) and consider the 
function 

H : M"" X M"" —>■ M U {-|-oo}, H{u,v) = {f + g){u) + — ||u — x|p. 

Then the following statements are true: 

(Hi) for almost every t G [0,-|-oo) it holds 

^Hix{t) + x{t),x(t)) < - 

and 

3 lim H{x{t) + xit), xit)) G M; 

*->■- 1-00 ^ ' 

(H 2 ) for almost every t G [0,-|-oo) it holds 

z{t) := ^-Vg{x{t))+ Vgix{t) + x{t)),--x{t)'^ e dHixft) + x{t),x{t)) 

and 

lk(t)|| < (^ + “) 

(Hs) for X G uj{x) and t^ —>■ -|-oo such that x(tfc) x as k ^ -|-oo, we have ff(x(ffc) -|- 
x{tk),x{tk)) — 7 > H(x,x) as k ^ -|-oo. 

Proof. (HI) follows from Lemma[6l The first statement in (H2) is a consequence of (Hip 
and the relation 

dH{u, v) = (5(/ -|- g)iu) -|- g~^{u — v)) x {g~^iv — u)} V(tt, x) G M"' x (23) 

while the second one is a consequence of the Lipschitz continuity of V 5 . Finally, (H3) has 
been shown as intermediate step in the proof of Lemma El ■ 


--(3 + ry/3)/3 
V 


< 0 
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Lemma 9 Suppose that f + g is bounded from below and ry > 0 fulfills the inequality ([9]) . 
For xq € EF, let x G C'^([0, +cx)),M"') be the unique global solution of ([2]) and consider the 
function 

H xM.^ {+oo}, H(u,v) = (/ + g)(u) + —lltt - vf. 

2 ry 

Suppose that x is bounded. Then the following statements are true: 

(a) uj{x + x,x) C crit(-fr) = {(tt, u) G M"- x M" : G crit(/ + g)}; 

(b) limt_j._|_oodist = 0 ; 

(c) u![x + x,x) is nonempty, compact and connected; 

(d) H is finite and constant on uj[x + x,x). 

Proof. (a), (b) and (d) are direct consequences Lemma El Lemma [3 and Lemma El 
Finally, (c) is a classical result from [53]. We also refer the reader to the proof of 
Theorem 4.1 in [ 6 ], where it is shown that the properties of uj{x) of being nonempty, 
compact and connected are generic for bounded trajectories fulfilling limt^+oo = 0). 


Remark 10 Suppose that ry > 0 fulfills the inequality ([9]) and f + g is cocoercive, that is 

lim {f + g){u) = + 00 . 

||r||^+oo 

For Xq G M”, let x G +oo),be the unique global solution of ([21). Then / + ^ is 

bounded from below and x is bounded. 

Indeed, since f + g is a proper, lower semicontinuous and coercive function, it follows 
that inf.ugRn[/(n) + g{u)] is finite and the infimum is attained. Hence f + g is bounded 
from below. On the other hand, from (|15p it follows 

if + g) {x{T) + x{T)) < if+ g) {x{T) + x{T)) + ^ l|i(r) f 

< if + 9){m+xo)) + ^\\mf vr>o. 

Since the lower level sets of f+g are bounded, the above inequality yields the boundedness 
of X + X, which combined with limt_,.+oo xit) =0 delivers the boundedness of x. 

We come now the main result of the paper. 

Theorem 11 Suppose that f + g is bounded from below and ry > 0 fulfills the inequality 
Q. For Xq G M”, letx G (^^([O,+oo), M"') he the unique global solution of ([2|) and consider 
the function 

H X ^ R U {+oo}, H{u,v) = (/ + g)iu) + —||u - vf. 

2 ry 

Suppose that x is bounded and H is a KL function. Then the following statements are 
true: 
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(a) X € L^([0,+oo);M"'); 

(b) there exists x € crit(/ + g) such that limt^+oo x{t) = x. 

Proof. According to Lemma [9l we can choose an element x G crit(/ + g) such that 
{x,x) G u}{x + x,x). According to LemmaEl it follows that 

^ lim H(^x(t) + x{t),x(t)) = H{x,x). 

We treat the following two cases separately. 

I. There exists t > 0 such that 

H{^x{t) + x{t), x{t)) = H{x,x). 

Since from Lemma [8)^H1) we have 

—H(x(t) + x{t),x{t)) < 0 Vt G [0, +oo), 

we obtain for every t >t that 

H[x{t) + x{t),x{t)) < H(^x{t) + x{t), x{t)) = H{x,x). 

Thus H{x{t) + x{t),x{t)) = H{x,x) for every t >t. This yields by Lemma[8jHl) that 
x{t) = 0 for almost every t G [t, +oo), hence x is constant on \t, +oo) and the conclusion 
follows. 

II. For every t > 0 it holds H{x{t) + x(t),x{t)) > H{x, x). Take fl = uj{x + x, x). 

In virtue of Lemma [9)^c) and (d) and since H is a KL function, by Lemma [H there 
exist positive numbers e and g and a concave function (p G 0,^ such that for all 

(x, y) €{{u, v) G x M" : dist((t(, v), fl) < e} 

n {(rt, u) G M"’ X M” : H{x,x) < H{u,v) < H{x,x) + g} (24) 

one has 

p'{H{x,y) - H{x,x))dist{{0,0),dH{x,y)) >1. (25) 

Let ti > 0 be such that H{x{t) + x{t),x{t)) < H{x,x) + 6 for all t > ti. Since 
limt_^+oo dist ^(x(t) + x{t),x{t)) = 0, there exists t 2 > 0 such that dist ^(x(t) + 

x(t), x(t)), < e for all t > t 2 . Hence for all t > T := max{ti,t 2 }, {x{t) +x(t),x(t)) 

belongs to the intersection in (j24p . Thus, according to ()25l) . for every t >T we have 

(x(t) + x(t),x(t)) — H(x,x)^ dist ^(0, 0), dJI(x(t) + x(t), x(t))'j > 1. (26) 

By applying Lemma [5KH2) we obtain for almost every t G [T, +oo) 

(/3 + g~^)llx(t)ll(p'(^ff(x(t) + x(t),x(t)) -II(x,x)J >1. (27) 

From here, by using Lemma [SKHl) and that p' > 0 and 

^(p(^ff(x(t) + x(t),x(t)) -iL(x,x)) = 

p'(^H[x(t) + x{t),x{t)) — H(x,x)^ -^H{x(t) + x{t),x{t)), 


11 


we deduce that for almost every t € [T, +oo) it holds 


dt 


ip(^H[x{t) + x{t),x{t)) - < - [P + r] ^ 


- (3 + r?/3)/3 


\m\- (28) 


Since (p is bounded from below, by taking into account Q, it follows x G -b^([0, +oo);R”). 
From here we obtain that limj_)._|_oo x{t) exists and this closes the proof. ■ 


Since the class of semi-algebraic functions is closed under addition (see for example [23] ) 
and {u,v) i-)- c||rt — up is semi-algebraic for c > 0 , we can stat the following direct 
consequence of the previous theorem. 


Corollary 12 Suppose that f + g is bounded from below and g > 0 fulfills the inequality 
dH). For xq G M”, let x G -|-oo),M”') be the unique global solution of ([2]). Suppose 

that X is bounded and f + g is semi-algebraic. Then the following statements are true: 

(a) X G L^([0,-l-oo); M"); 

(b) there exists x G crit(/ -|- g) such that lim^^+oo x{t) = x. 


3.2 Convergence rates 

In this subsection we investigate the convergence rates of the trajectories generated by 
the dynamical system ([2]). When solving optimization problems involving KL functions, 
convergence rates have been proved to depend on the so-called Lojasiewicz exponent (see 
imiioiEaETi). The main result of this subsection refer to the KL functions which satisfy 
Definition [1] for (^(s) = Cs^~^, where C > 0 and 6 G (0,1). We recall the following 
definition considered in m- 

Definition 3 Let / : M”' —)• M U {-|-oo} be a proper and lower semicontinuous function. 
The function / is said to have the Lojasiewicz property, if for every x G crit / there exist 
C,e > 0 and 9 G (0,1) such that 

\f{x) — f{x)f < C'||x*|| for every x fulfilling ||x — x\\<£ and every x* G df{x). (29) 

According to [121 Lemma 2.1 and Remark 3.2(b)], the KL property is automatically 
satisfied at any noncritical point, fact which motivates the restriction to critical points 
in the above definition. The real number 6 in the above definition is called Lojasiewicz 
exponent of the function / at the critical point x. 

Theorem 13 Suppose that f + g is bounded from below and ry > 0 fulfills the inequality 
Q. For xo G M”, letx G (^^([O,-|-oo), M"') be the unique global solution of ([2]) and consider 
the function 

H : M"' X M” —M U {-|-oo}, Hiu, v) = if + g){u) H- . 

2ry 

Suppose that x is bounded and H satisfies DefinitionU\ for ip{s) = Cs^~^, where C > 0 
and 6 G (0,1). Then there exists x G crit(/ -|- g) such that limt_>.+oo x{t) = x. Let 6 be the 
Lojasiewicz exponent of H at (x, x) G crit H, according to the Definition 0 Then there 
exist a,b,c,d > 0 and to > 0 such that for every t > to the following statements are true: 
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(a) if 0 ^ (0, ^), then x converges in finite time; 

(b) if 0 = ^, then ||x(t) —x\\ < aexp(—6t); 

(c) if 6 & (^, 1), then ||x(t) — x\\ < {ct + 

Proof. We define for every f > 0 (see also [20]) 


/ + 00 

||x(s)||ds for all t > 0. 


a{t} = 

It is immediate that 

||x(t) — x|| < a{t) Vt > 0. 
Indeed, this follows by noticing that for T >t 

rT 


(30) 


|x(t) — x|| = ||x(T) — X — 


x(s)(is|| 

< ||x(r) — x|| + ^ ||x(s)||(is 


and by letting afterwards T —+oo. 

We assume that for every t > 0 we have H[x{t) + x(t), x(t)) > H{x,x). As seen in the 
proof of Theorem II11 in the other case the conclusion follows automatically. Furthermore, 
by invoking again the proof of above-named result, there exist to > 0 and M > 0 such 
that for every t > to (see (1281)1 


M\\x{t)\\ + ^ (^H{x{t) + x{t),x{t)) - H{x,x)^ 


1 i-e 


< 0 


and 


||(x(t) -hx(t),x(t)) - (x,x)|| < e 
We derive by integration (for T > t >to) 

M ||x(s)||(is+ [h[x{T) + x{T),x{T)) - H{x,x)) 
H{x{t) + x{t)^ x{ty) — H{x,x)j 


1 1-0 


< 


11-0 


hence 


11-0 


(31) 


Ma{t) < (^H(^x{t) + x{t),x{t)^ — H{x,x)j Vt > to- 

Since 0 is the Lojasiewicz exponent of H at (x, x), we have 

\H (x(t) -|- x(t), x(t)) — H{x,x)f < C'||x*|| Vx* G dH (x(t) -|- x(t), x(t)) 

for every t > to- According to Lemma [8KH2), we can find a constant > 0 such that for 
almost every t G [to,+oo) there exists x*{t) G dH{x{t) -|-x(t), x(t)) fulfilling 


||x*(t)||<iV||x(t)||. 
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From the above two inequalities we derive for almost every t € [to, +oo) 

\H(^x{t) + x{t),x{t)) — H{x,x)f < C ■ A^||x(t)||, 
which combined with (1311) yields 

Ma{t) < {C ■ N\\x{t)\\)^. (32) 

Since 

d(t) =-||x(t)|| (33) 

we conclude that there exists a > 0 such that for almost every t € [to, +oo) 

&(t) < —a((T(t)) (34) 

If 0 = ^, then 

d-{t) < —aa{t) 

for almost every t G [to,+oo). By multiplying with exp(at) and integrating afterwards 
from to to t, it follows that there exist a,b > 0 such that 


a{t) < aexp(— 6 t) Vt > to 


and the conclusion of (b) is immediate from (I30p . 
Assume that 0 < 0 < ^. We obtain from 

d ( 1-29 \ 1 — 20 

— (T 1-9 < —a -— 

dt\ ) 1 — 0 


for almost every t € [to, +oo). 
By integration we get 


[cr 


(*)) 


1-26 _ 

< —at + /? Vt > to, 


where a > 0. Thus there exists T > 0 such that 


a{T) < 0 Vt > T, 


which implies that x is constant on [T, Too). 

Finally, suppose that ^ < 0 < 1. We obtain from (|M1) 


d 


> a- 


20 - 1 


1 - 


By integration one derives 

o'it) < {ct + d)“(29-i) Vt > to, 
where c,d>0, and (c) follows from ([30|) . 
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